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Complexity theory as practiced by physicists and computational complexity theory as practiced by computer 
scientists both characterize how difficult it is to solve complex problems. Here it is shown that the parameters of 
a specific model can be adjusted so that the problem of finding its global energy minimum is extremely sensitive 
to small changes in the problem statement. This result has implications not only for studies of the physics 
of random systems but may also lead to new strategies for resolving the well-known P versus NP question in 
computational complexity theory. 



Computational complexity theory addresses the 
question of how fast the resources required to solve a 
given problem grow with the size of the input needed 
to specify the problem. [1] The close relationships be- 
tween the physics of random systems and computa- 
tional complexity theory have been explored for nearly 
two decades. [2, 3] 

Whether or not P, the complexity class of problems 
that can be solved in a time that grows polynomially 
with the size of the problem specification ("polynomial 
time"), and NP, the class of problems for which a solu- 
tion can be verified in polynomial time, are distinct is 
a central unanswered question in computational com- 
plexity theory. [4] The class of NP-complete problems 
are equivalent in that being able to solve any one of 
them in polynomial time implies that any problem in 
NP can be solved in polynomial time. [5-7] An intuitive 
picture believed to be appropriate for NP-complete 
problems is that the presence of conflicting constraints, 
or "frustration," [8] causes each problem to have an "en- 
ergy landscape" with many local minima, and finding 
the global minimum is difficult because typical algo- 
rithms must explore an extremely large number of local 
minima to find the global one. [2] 

Here it is shown that the energy landscapes of NP- 
complete problems have important differences in their 
local properties. Specifically, it is demonstrated that 
the parameters of a particular problem in NP can be 
adjusted so that the solution is extremely sensitive to 
small changes in the problem, and it is argued that ex- 
ploiting this sensitivity may lead to new strategies for 
resolving the P versus NP question. 

We consider here a specific system called a Kauff- 
man net, or N-K model. [9] It has Boolean elements 
(Ti, i=l, 2,..., A^, and the value of the i*'* element at time 
t+l is determined by the value of its K inputs 



i2{i), ■■■,jK{i) at timer via 

<T,{t+l) = f,{aj^(i){t),a.j^(i^{t), . . . ,(Tj^(j)(i)), (1) 

where each /; is a randomly chosen Boolean function 
that depends on K arguments. The K inputs for each el- 
ement and the Boolean functions fi are all chosen ran- 
domly before beginning and then fixed throughout the 
computation. Specifying a Kauffman net requires time 
and space polynomial in so long as K grows no faster 
than log(A^j: this follows because specifying the K in- 
puts for each of the elements takes a number of bits 
proportional to NK log(N), and specifying the fi takes 
N2^ bits (one per output for each of the 2^ possible 
inputs for each element). For the predecessor problem, 
a natural choice for the energy of a given configuration 
{t} is the number of bits in the successor configura- 
tion {o'}=/({t}) that differ from the corresponding bit 
in the target configuration. [10] 

Here we consider the problem of determining 
whether a given configuration of a Kauffman net 
{a} = {fJi, (T2, . . . , cTjv} has a predecessor. When 
K = N, although specifying the model requires space 
that grows exponentially with N, one can still ask how 
many evaluations of the Boolean functions are required 
to determine whether such a predecessor exists. A 
candidate solution can be verified with a single eval- 
uation of each Kauffman net function, but because in 
this case each configuration is a truly random function 
of its predecessor[l 1, 12], the only way to determine 
whether a predecessor exists is to check all of the ex- 
ponentially many candidates. [13] 

When K — A logj N with A a constant, the prob- 
lem of determining whether a given configuration has 
a predecessor is in NP. The problem is potentially hard 
because one must determine whether many different, 
potentially conflicting constraints can be satisfied si- 
multaneously. Goldreich[14] has speculated that find- 
ing a predecessor requires time exponential in N, and 
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the question of whether a given configuration of a given 
Kauffman net has a predecessor can easily be rewritten 
as an instance of satisfiability, a classic NP-complete 
problem. [7] The instances of satisfiabiUty that corre- 
spond to randomly chosen Kauffman nets are expected 
to require exponential time for any /r>3.[15] 

For any K > 2, local search algorithms that work 
by decreasing the number of wrong bits by changing 
a small number of bits in the current "guess" of the 
predecessor typically find only a local minimum and 
not the global one. A new ingredient that enters for 
K — A log2 N is that finding the global minimum is 
hard even if one starts off with a configuration whose 
successor has only one bit in error. In contrast, if one 
has found a configuration whose successor differs from 
the target by one bit for a random problem instance 
with K='i, the error can be corrected with very high 
probabiUty via a small number of single bit flips. In 
addition, when K=Mog2N with A large enough, if the 
target configuration with the single bit flip has a prede- 
cessor, the number of bits in the predecessor configura- 
tion that must be changed grows as a power of A^, while 
when K=3 a change in a single bit in the target results 
in a change of only 0(1) bits of the predecessor. 

The sensitivity of the predecessor configuration to 
single-bit changes in the target constrains the computa- 
tional strategies that could solve the predecessor prob- 
lem in polynomial time. First, the algorithm must yield 
the exact answer, since the local search algorithm can- 
not correct even single-bit errors. Second, the algo- 
rithm must explicitly depend on the specification of 
every bit of every input function as well as every bit 
of the target configuration. This is because if one re- 
alization of the functions yields the target output, then 
a second function realization that differs from the first 
by a single bit change could yield a configuration that 
differs from the target by one bit, and the arguments 
given above then demonstrate that the predecessor for 
the second function realization, if it exists, has a large 
number of bits that are different than for the first func- 
tion reaUzation. 

The extreme sensitivity of the predecessor config- 
uration to small changes in the target suggests that a 
strategy for providing a lower bound on the difficulty 
of solving the predecessor problem could be to inves- 
tigate the complexity of the polynomial describing the 
predecessor function. For example, one could define 
a function gi{<Ti, (T2, . . . , crjv) to be zero if the config- 
uration {a} has a single predecessor {r} with Ti=0, 



one if {a} has a single predecessor {r} with Ti=l, 
two if the configuration {a} has no predecessor, and 
three if {a} has more than one predecessor. The de- 
gree of this polynomial is bounded below by the num- 
ber of its zeros, and since changes of a single bit in the 
target change many bits of the predecessor, the num- 
ber of zeros of this polynomial grows approximately 
as fast as the number of target configurations that have 
a single predecessor. Moreover, the sensitive depen- 
dence of the polynomial's coefficients on the choice 
of the Kauffman net functions constrain the possible 
compact algorithms for computing them. Implement- 
ing this strategy is nontrivial, since one must prove 
that the number of target configurations with a sin- 
gle predecessor grows faster than polynomially with 
as well as that the large number of different possible 
polynomials precludes efficient computation of the co- 
efficients. Nonetheless, considering random networks 
with K oc log N is useful in this context because the 
sensitivity of the predecessor to single bit changes in 
the successor enables one to relate the number of sign 
changes of the function to the number of configurations 
with a single predecessor. 

To demonstrate the increasing sensitivity of the so- 
lution of the predecessor problem to single-bit changes 
in the target as K is increased, one assumes that a one 
is given a configuration {r} such that /({r})={?7} dif- 
fers from the target configuration {a} by exactly one 
bit. One then attempts to find the state {i^} such that 
/({z^})={cr} as follows: (1) For each of the K inputs of 
the wrong element i, find the configuration that results 
when a given input is flipped, and (2) flip the input of 
i that minimizes the number of wrong elements in the 
output. This "downhill" algorithm succeeds if single- 
element changes of {r} yield no errors in the output 
instead of one error. 

This algorithm is characterized here using methods 
similar to those in [16, 17]. Starting with a configura- 
tion that yields a successor that differs from the target 
by one bit, the probability that flipping one given in- 
put of the wrong bit causes the output result to have k 
errors is 

Eq. (2) follows because a given input affects K ele- 
ments, and the output for each is correct with proba- 
bility 1/2. 

Now one gets to pick the input that yields the fewest 
incorrect outputs. Defining QkU) as the probabiUty 
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that the best output configuration differs from the target 
I 



Qk{0) = 1-(1-Pif(0)) 



Qk{K) = 




Eqs. (3) follow because if the smallest number of 
errors yielded by this process is /, no trials can yield a 
number of errors less than i, at least one trial must yield 

( ' V 

J errors, and 1 — / PkU) is the probabiUty that 

\ / 
only more than ; errors are obtained. 

This procedure fixes the error if the resulting config- 
uration has no wrong bits. If the number of wrong bits 
is one, then it is likely that a different element £ is now 
wrong, and one can repeat the procedure and perhaps 
find a correct solution in the next iteration. If the num- 
ber of wrong bits is more than one, then the process has 
yielded a configuration that is farther from a solution. 

One way to estimate whether the process is getting 
closer to or farther from a solution is to calculate after 
one step of the procedure the expectation value of the 
number of wrong bits, {N error {K)), 

K 

{N,rror{K)) = Y,KQk{3) ■ (4) 

Now {Nprror{K)) iucrcascs monotonically 
with K, and {Nerror{K = 3)) = 0.797 and 
{Nerror{K = 4)) = 1.005, SO the number of 
wrong bits is reduced by the procedure when K=3 but 
not when K=4. Thus, it appears that the procedure 
corrects the one-bit error with high probability for 
some values of K strictly greater than 3, but not when 
K is larger than 4. 

The energy landscape of the model becomes increas- 
ingly "rugged" as K is increased. [18], and the prob- 
ability that the downhill algorithm fixes the error de- 
creases monotonically as K increases. When K = 
A log2 N, the number of wrong bits after one step is 



in j bits, one finds 




l<j<K-l 



(3) 

I 

strongly peaked at K/2 = {A/2) logg N, and the prob- 
ability that the operation yields either zero errors or one 
error oc N~^, and the probability of being able to cor- 
rect any one-bit error vanishes as AT — > oo. 

Now it is shown that if the target configuration that is 

changed by one bit has a predecessor, for large enough 
A the new predecessor configuration differs from the 
original one by a number of bits that grows at least 
as fast as A^^, with x strictly greater than zero. This 
follows because (1) changing a single input bit is ex- 
tremely Ukely to change many output bits, and (2) if 
one chooses M random numbers out of possibili- 
ties, when M is much smaller than a/1v, the proba- 
bility of duphcation is exponentially small in the ratio 
M/VN.[19] 

Here, we consider Kauffman nets in which each el- 
ement has exactly K inputs and K outputs, a restric- 
tion that does not affect any of the results but sim- 
plifies the analysis. One begins with a configuration 
{r} such that f({T}) is the target configuration {a}, 
and now considers a new target configuration {a'} that 
is identical to {a} except for a single bit flip. One 
then asks how many bits one must flip in the config- 
uration {r} to obtain a configuration {t'} such that 
f({r'})={cr'}. To see that {t'} differs from {r} by 
many bits, consider all configurations that differ from 
the original predecessor {t} by S bits, where S < A^^, 
with x< 1/2. The number of different ways that these 
5 bits can be chosen is N\/ [S\ {N - 5)!], which can 
be written {Ne/sf + O [s^/N) when N and S are 
large and S<< VlV. Next we define Q to be the num- 
ber of elements with at least one input that has been 
changed. When S« Vn /K and K is large, Q>SK/2. 
This is because the number of affected outputs would 
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be SK if none were duplicated, and while one can 
obtain individual duplications of an output by choos- 
ing inputs that have a common output, the probabil- 
ity of obtaining additional dupUcations when the con- 
nections are chosen randomly is negligible so long as 
SK« ^/n. Now we define R to be the number of el- 
ements whose output value has changed. When Q is 
large, given a realization with Q outputs that have at 
least one perturbed input, the probability distribution 
governing the number of output bits that are different 
from the original target is a normal distribution with 
mean Q/2 and standard deviation y^Q/2.[20] There- 
fore, the probabiUty that R<Q/4 for such a realization 
must be less than ((5/4) exp (Q/4 - Q/2f /2Q = 

(Q/4)exp(-QV32). 

So now finally we show that when A is large enough 
the probabiUty that a choice of the S inputs exists for 
which R<SK/8 is smaller than 1/N as N^od. This 
follows because the probability that Q>SK/2 is essen- 
tially unity and that the probability that R <QK/A is very 
small. Specifically, the conclusion follows if 



Ne 

— ) gexp[-Q/32]<l. 



For Q>SK/2 and K=Alog2N, one has 

NeY ^ _Q /A^e\^ f SK\ r 



(5) 
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The expression (6) becomes arbitrarily small as 
N^oo for any 5<A'^^ with x<l/2 when A/64 In 2 >1. 

Thus, we have shown that no configuration that dif- 
fers from the unperturbed predecessor by a number of 
bits that is smaller than SocN^ with x<l/2 can be the 
predecessor of a new target configuration that differs 
from the original target by Of 1 j bits. 

To summarize, we have shown that the problem of 
finding a predecessor configuration of a random Kauff- 
man net in which each element has a number of con- 
nections that grows logarithmically with the number of 



elements is extremely sensitive to single-bit changes in 
the target configuration. We are optimistic that this 
sensitivity to small changes can be exploited to de- 
velop new strategies to attack the difficult question of 
whether the complexity P and NP are distinct. 
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